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ABSTRACT 



Colombia’s PACES program provided over 125,000 pupils from poor neighborhoods with 
vouchers that covered approximately half the cost of private secondary school . Since many vouchers were 
allocated by lottery, we use differences in outcomes between lottery winners and losers to assess program 
effects. Three years into the program, lottery winners were 15 percentage points more likely to have 
attended private school, had completed . 1 more years of schooling, and were about 1 0 percentage points 
more likely to have finished 8 th grade, primarily because they were less likely to repeat grades. The 
program did not significantly affect dropout rates. Lottery winners scored .2 standard deviations higher 
on standardized tests. There is some evidence that winners worked less than losers and were less likely 
to marry or cohabit as teenagers. On average, lottery winners increased their educational expenditure by 
about 70% of the value of the voucher. Since winners also worked less, they devoted more total resources 
to education. Compared to an equivalent expansion of the public education system, the voucher program 
increased annual government educational expenditure by about $24 per winner. But the costs to the 
government and to participants were probably much less than the increase in winners’ earnings due to 
greater educational attainment. 
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The question of who should provide education is nowhere more pressing than in developing countries. 
While the academic controversy over school providers and school vouchers has raged most intensely in the 
US, private schools account for only about 1 1% of US enrollment (USDOE, 1998). Moreover, over half of 
American parents report that they are very satisfied with the public schools their children attend. In the 
developing world, in contrast, private enrollment as a proportion of total enrollment is 2-3 times higher than 
that in industrialized nations (James, 1993). Problems with public schools are usually more severe in low- 
income countries, since the quality and integrity of public-sector service-delivery is highly correlated with 
income levels (Rauch and Evans, 2000). In Indian schools, for example, a recent study found that one-third 
of headmasters were absent at the time of the researchers’ visit (PROBE Team, 1999), while in Kenya, 
Glewwe, Kremer, and Moulin (2000) found that teachers were absent 28% of the time. The view that private 
schools function better than public schools in the developing world has prompted calls for governments in 
poor countries to experiment with demand-side financing programs such as vouchers (e.g, Psacharopolous, 
Tan, and Jimenez, 1986). 

This paper presents evidence on the impact of one of the largest school voucher programs to date, the 
Programa de Ampliation de Cobertura de la Education Secundaria (PACES), a Colombian program which 
provided over 125,000 pupils with vouchers covering somewhat more than half the cost of private secondary 
school. Vouchers could be renewed as long as students maintained satisfactory academic performance. Since 
many vouchers were awarded by lottery, we use a quasi-experimental research design comparing educational 
and other outcomes of lottery winners and losers. Subject to a variety of caveats, the resulting estimates 
provide evidence on program effects similar to those arising from a randomized trial. As far as we know, ours 
is the first study of a private school voucher program in a developing country to take advantage of randomized 
treatment. 1 

'US studies in this mold include Green, Peterson, and Du ( 1996) and Rouse (1998), who evaluated a voucher lotteiy 
in Milwaukee. Rouse’s estimates, which control for attrition, show modest increases in math scores among voucher 
recipients. Other US studies include Howell et al (2000), Myers et al (2000) and Bettinger (2001a), who evaluate 
various private scholarship programs. Also related is McEwan and Camoy (1999), who report differences-in- 
differences estimates of spillover effects from a large-scale voucher program in Chile. Bellow and King (1993) 
assess a smaller program in Bangladesh. The literature on public/private comparisons in the US is extensive. Two 
recent studies are Evans and Schwab (1995) and Neal (1997). Cox and Jimenez (1991) compare public and private 
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Our research strategy was to survey lottery winners and losers from three applicant cohorts. The 
results from this survey show no significant enrollment differences between lottery losers and winners three 
years after application, with most pupils in both the winner and loser groups still in school. But lottery 
winners were 1 5 percentage points more likely to attend private schools rather than public schools. Moreover, 
lottery winners had completed an additional .1 years of school and were about 10 percentage points more 
likely than losers to have completed 8 th grade, primarily because they repeated fewer grades. Although high 
rates of grade repetition are a widely recognized problem in Latin America (see, e.g., Jacoby, 1994; and 
Psacharopoulos and Velez, 1993), reduced repetition need not indicate greater learning. We therefore 
administered achievement tests to a subset of the pupils surveyed. The test results suggest that, on average, 
lottery winners scored about .2 standard deviations higher than losers, a large but only marginally significant 
difference. The effect on girls is larger and more precisely estimated than the effect on boys. 

In addition to increased educational attainment and academic achievement, there is also some 
evidence that the voucher program affected non-educational outcomes. In particular, lottery winners were 
less likely to be married or cohabiting and worked about 1 .2 fewer hours per week (again, mostly a difference 
for girls). Both of these results suggest an increased focus on schooling among winners. 

While comparisons between winners and losers provide a simple strategy for assessing program 
impact, our survey indicates that only about 90% of lottery winners had ever used the voucher or any other 
type of scholarship, while 24% of losers received scholarships from other sources. It therefore seems 
reasonable to think of lottery win/loss status as an instrument for scholarship receipt in a two-stage least 
squares (2SLS) set-up. There is a strong first-stage here, though the relationship between voucher status and 
scholarship use is not deterministic. Instrumenting for scholarship use with lottery win/loss status suggests 
that scholarship use generated effects on grade completion and test scores that are roughly 50% larger than 



schools in Colombia and Tanzania, and Jimenez, Lockheed, and Paqueo (1991 ) summarize comparisons in five 
countries. See also the Patrinos and Ariasingham (1997) survey of demand-side financing in poor countries. 
Glewwe, Kremer, and Moulin (2000) and Behrman, Sengupta, and Todd (2000) use randomization to examine other 
educational interventions in developing countries, 
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the reduced form effect of winning the lottery. 

The last part of the paper presents a fiscal and cost-benefit analysis of the voucher program. Most 
lottery winners would have attended private school anyway, at least for a few years, and therefore reduced 
their educational expenditure in response to the program. On the other hand, voucher winners who were 
induced to switch from public to private schools greatly increased their educational expenditure, since the 
voucher covered only about half the cost of private school. On balance, winners’ gross school fees exceeded 
those of losers by about 70% of the amount they received from the voucher. This increase comes from the 
discrete jump in fees for those who switched from public to private schools, and from the fact that winners 
who would have gone to private school anyway spent more on school fees, possibly because they went to 
better schools. Moreover, lottery winners worked less, so that, on balance, households winning the lottery 
actually devoted more resources to education than the voucher face value. We also estimate that the voucher 
program cost the government about $24 more per winner than the cost of creating a public school placement. 
These costs to participants and the government are likely to have been outweighed by the benefits of the 
voucher to participants — in the form of the economic return to increased educational attainment and test 
scores. 

The paper is organized as follows. Section I provides background on education in Colombia and 
describes the PACES program in more detail. Section II discusses data and presents descriptive statistics from 
our survey. Section III discusses the effect of the program on school choice and basic educational outcomes. 
Section IV reports the effect of winning a voucher on test scores and non-education outcomes. Section V 
discusses the use of lottery win/loss status as an instrument to identify the causal effect of receiving a 
scholarship. Finally, Section VI looks at the effect of the program on household and government expenditure, 
and compares program costs with the benefits to participants. 
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I. Background 



The Colombian government established the PACES program in late 1991 as part of a wider 
decentralization effort and in an attempt to expand private provision of public services (King et al , 1997). 
The program, which was partly funded by the World Bank, was also motivated as an effort to quickly expand 
school capacity and to raise secondary school enrollment rates (King, Orazem, and Wolgemuth, 1998). 2 
Although 89% of Colombia’s primary-school age children were enrolled in 1993, only 75% of the eligible 
population was enrolled in secondary schools. Among children of eligible age in the poorest quintile of the 
population, 78% were enrolled in primary school, but only 55% were enrolled in secondary school (Sanchez 
and Mendez, 1995; note that secondary school covers grades 6-1 1 in Colombia.) 

The PACES program targeted low-income families by offering vouchers only to children residing in 
neighborhoods classified as falling into the two lowest socioeconomic strata (out of 6 possible strata). 
Applicants had to submit a utility bill to establish residential location and voucher eligibility. A second 
important feature of program targeting was that vouchers were offered only to children attending public 
primary schools. This restriction further excluded upper-income households since almost half of children 
from the richest income quintile attended private primary schools. Studies by Morales-Cobo (1993) and 
Ribero and Tenjo (1997) suggests that the targeting was largely effective in Bogota. 

PACES vouchers were worth only about US$190 at the time of our survey. The maximum voucher 
value was set initially to correspond to the average tuition of low-to-middle cost private schools in Colombia’s 
three largest cities. Schools charging less than the vouchers’ face value received only their usual tuition. 
PACES vouchers became less generous over time because they did not keep up with inflation, and hence 
recipients had to supplement vouchers with additional payments to cover school fees. Our survey data show 



2 PACES was launched in November 1991 with advertisements in paint and on radio soliciting applicants in 
participating cities (Calderon, 1996). A World Bank (1993) report on Colombian secondary schools notes that most 
schools operated 2 or 3 shifts and that some towns have little room for additional pupils in spite of projected 
enrollment growth. Other problems mentioned in the report include poor primary-school preparation, weak school 
management, lack of teacher preparedness, lack of textbooks, and shortages of other supplemental materials. The 
early 1990s was a general period of reform and liberalization in Colombia; see, for example, Kugler (1999). 



matriculation and monthly fees for private schools attended by voucher applicants in 1998 averaged about 
$340. By way of comparison, the average annual per-pupil public expenditure in Colombia’s public 
secondary school system in 1995 was just over $350 (DNP, 1999), and public school parents in our sample 
typically had to pay tuition or fees of roughly $58. Per capita GNP in Colombia is now around $2,280 (World 
Bank, 1999). 

To qualify for a voucher, applicants must have been entering the Colombian secondary school cycle 
which begins with grade 6, and be aged 1 5 or under. They must also have been admitted to a participating 
secondary school (i.e., one that would accept the voucher). 3 Participating schools had to be located in 
participating towns, which included all of Colombia’s largest cities. Just under half of private schools in the 
10 largest cities accepted vouchers in 1993. 

Participating schools tended to serve lower-income pupils, and to have lower tuition than non- 
participating private schools. Schools with a vocational curriculum were also over-represented among those 
in the program. Initially, vouchers were good at both for-profit and non-profit schools, but after 1996, for- 
profit schools were excluded. 4 The number of vouchers in use in any one year peaked at roughly 90,000 in 
1994 and 1995. There were approximately 3.1 million secondary school pupils in Colombia in 1995, 37% 
of whom attended private schools. In Bogota, roughly 58% of 567,000 secondary school pupils attended 
private school. 

T est score comparisons reported by King et al ( 1 997) show achievement levels in participating private 
schools were very close to those in public schools, though significantly below achievement levels in non- 
participating private schools. Similarly, pupil-teacher ratios and facilities were similar in public and 
participating private schools, while non-participating private schools had lower pupil-teacher ratios and the 



background information in this section is taken from King et a/ (1997), Calderon (1996), and unpublished ICETEX 
documents. 

4 Problems were reported with low-quality schools created to exploit the vouchers, But Calderon (1996) notes that 
even before the non-profit restriction was imposed, only 15% of Bogota’s voucher students attended such 
institutions. 




10 



best facilities. Clearly, then, relatively elite private schools opted-out of the PACES program. One reason 
for this may have been a reluctance to interact with the bureaucracy in the Colombian Institute for Education, 
Credit and Training Abroad (ICETEX), a government agency that ran the program. Moreover, vouchers were 
insufficient to cover much of the tuition at more expensive schools, and some school managers probably 
viewed the prospect of an influx of pupils from low-income backgrounds as undesirable. On the other hand, 
many private schools in Colombia serving low-income populations apparently welcomed the PACES program. 

Voucher recipients were eligible for automatic renewal through eleventh grade, when Colombian high 
school ends, provided the recipient’s academic performance warranted promotion to the next grade. Students 
failing a grade were supposed to be dropped from the PACES program. Figures from Calderon (1996) show 
that, on average, 77% of recipients renewed their vouchers, and estimates from our data are similar. By way 
of comparison, the national high school promotion rate was about 70%. Students who transferred from one 
participating private school to another could, in principle, transfer the voucher to the new school. In practice, 
however, our survey suggests many students who transferred schools after winning lost their vouchers. 

Cities and towns used lotteries to allocate vouchers when demand exceeded supply. Municipal 
governments paid 20% of the voucher cost, while the central government paid 80%. Each municipality 
decided how many vouchers to fund, subject to a maximum allocated to towns by the central government. 
This allocation was determined by estimating the shortfall between primary school enrollment and the 
available space in public secondary schools. Voucher award rates therefore varied considerably by city and 
year, depending on the ratio of applicants to available vouchers. Regional ICETEX offices worked with 
individual municipalities to determine the number of vouchers to be funded, to check school requirements for 
participation, and to monitor implementation of the program. The Bogota ICETEX office provided software 
and instructions to regional offices for the purposes of random selection of applicants in cases of over- 
subscription. We obtained copies of lists of lottery winners and losers from ICETEX offices. 5 



J In a few cities, the local ICETEX office assigned vouchers based on pupils’ primary school performance instead of 
randomly. 
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